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A. Error In The '386 Patent For Which Correction Is Requested 

There is one inventor named in the issued '386 patent. The name that currently appears 
on the face of the patent is Kiyoji Sekiguchi. The correct name of the inventor should be Kyoji 
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ABSTRACT 



To synthesize an aperture mask having unnoticeable steps 
with a taken fundus image. In an image processing appara- 
tus, taken fundus image data is inputted and then analyzed. 
After that, an aperture mask is selected and inputted as 
aperture mask data, and an image size of the fundus image 
compared with an image size of the aperture mask. The 
image size of the aperture mask is adjusted to the image size 
of the fundus image and then the fundus image data and the 
aperture mask data are developed in raster format to image 
memories. The image size of the fundus image is adjusted to 
the image size of the aperture mask based on the comparison 
result and a coefficient for low pass filtering process is 
determined according to the image size of the fundus image. 
After that, the degree of clearness of corresponding fundus 
image data is calculated based on each pixel value of the 
aperture mask data on which the low pass filtering process 
has been performed and the calculation result is outputted to 
the image memory. After the process is performed for all the 
pixels, a fundus area in the fundus image is moved to 
predetermined coordinates. A resultant fundus image is 
outputted as final image data to a storage device and a 
display memory and then a series of processes are com- 
pleted. 

9 Claims, 7 Drawing Sheets 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to an ophthalmologic image 
processing apparatus used for ophthalmologic examination 
in an ophthalmologic clinic and the like. 

2. Related Background Art 

In a conventional fundus camera, image taking is per- 
formed with an aperture mask that performs light shielding 
on an area other than a central region inside a flare region 
located at a position immediately before an image pickup 
plane or at an equivalent position on an optical path, in order 
to determine an effective image taking area by eliminating a 
flare caused near a formed image, to determine a positional 
relationship between the image and an eye to be examined, 
or to determine a left or right eye in a case of picking up a 
pair of a papillary area and a macular area. In such fundus 
camera, because the aperture mask is located near an imag- 
ing plane of a fundus image, a boundary between the fundus 
image and the mask on the taken image is natural, so that a 
smooth image can be obtained. 

On the other hand, there exists a fundus camera that 
produces a fundus image without using the aperture mask. 
However, the fundus image taken by such fundus camera has 
an unnecessary flare caused in ihe vicinity thereof, an image 
taking direction thereof cannot be checked, or left or right 
eye may be inadvertently determined. Therefore, when 
printing the images thereof, various problems may occur in 
the diagnostic process. 

Therefore, as disclosed in Japanese Patent Application 
Laid-Open No. H9-206278, a method of electrically adding 
an aperture mask to a fundus image by synthesizing pro- 
cessing has been proposed. In this method, image processing 
for replacing a signal in an aperture mask area on the taken 
fundus image with data of a black level is performed. In the 
case where the fundus image is a video signal, the signal is 
changed into a signal of the black level at a display timing 
of the aperture mask area. In the case where the fundus 
image is inputted as image data, a black value is written into 
each pixel data in the aperture mask area. 

However, performing the above-mentioned image pro- 
cessing to add the aperture mask causes the following 
problem. That is, generally, the fundus image becomes a 
circular image or an oval image whose top and bottom 
portions are chipped because an image taking object is 
spherical and it is preferable to perform image taking for its 
maximum area. Therefore, the vicinities of a horizontal 
portion and a vertical portion of the image become a gentle 
curve. However, in the case where an aperture mask process 
is performed on such a fundus image, an aliasing (step 
portion) is caused in the boundary between the aperture 
mask and the fundus. In particular, the aliasing becomes 
conspicuous in the gentle curve part of the horizontal and 
vertical portions, so that a region having developed the steps 
is very noticeable due to an extremely high contrast. 

FIG. 8 is an explanatory view showing a fundus image 
synthesized with the aperture mask. This is an image 
obtained by synthesizing an aperture mask with a fundus 
image taken with the fundus camera using no aperture mask 
by a conventional method. 

FIGS. 9A and 9B each show an enlarged image of a 
horizontal portion A and an enlarged image of a vertical 
portion B in the boundary region between the aperture mask 
and the fundus image as shown in FIG. 8. As is also apparent 



from the enlarged images, the boundary line between the 
aperture mask and the fundus image is a gentle curve. 
Therefore, the steps are very noticeable. 

Further, a viewer may visually sense the step portion as a 
noise to hinder diagnosing operation. Alternatively, a viewer 
may feel uncomfortable with the image having the aperture 
mask, and this becomes a factor of a viewer's fatigue in 
diagnosing operation in which the viewer views several tens 

3 to several hundreds of images per day. Even in the case 
where the step portion is viewed through either a monitor or 
a printed paper, the similar influences are caused. In par- 
ticular, in the case where the step portion is viewed through 
a monitor having a small number of pixels, the influences are 

5 noticeable. 

In the case where the synthesized image is transmitted 
through a communication unit or subjected to JPEG com- 
pression for storage, the step portion becomes a discontinu- 
ous image. Consequently, there is a problem in that a contour 

3 in which the boundary portion between the fundus image 
and the aperture mask appears somewhat bright develops. A 
false color is generated in the portion which appears bright 
and it is a color which is not included in the original fundus 
image, so that attention is required for diagnosis. In order to 
suppress the generation of the false color, it is necessary to 
reduce the degree of compression, which means that it is 
useless to perform the compression. Further, because the 
step portion has a large number of harmonic components, 

3 there is a problem in that the compression efficiency is 
reduced. 

SUMMARY OF THE INVENTION 

5 As described above, there is the case where defects are 
caused in synthesizing an aperture mask with a fundus 
image in the conventional ophthalmologic image processing 
apparatus. Thus, various measures against the defects are 
desired. 

The present invention has been made in view of the 
above-mentioned problems. Therefore, an object of the 
present invention is to provide an ophthalmologic image 
processing apparatus that produces a synthesized image with 
- less sense of discomfort in synthesizing process for synthe- 
sizing a fundus image with an aperture mask image. 

According to the present invention, there is provided an 
ophthalmologic image processing apparatus that masks a 
fundus image using an aperture mask image, including: 
3 input means for inputting the fundus image; 

image generation means for generating an aperture mask 
image in accordance with information of the fundus 
image or inputting the aperture mask image; 
image adjustment means for adjusting a value of the 
' fundus image; and 

synthesizing means for synthesizing the fundus image 
whose value is adjusted with the aperture mask image, 
in which the image adjustment means adjusts the value of 
3 the fundus image based on coordinates in a boundary 
between a mask area of the aperture mask image and an 
area of the fundus image. 
Other objects, features and advantages of the present 
invention will be apparent from the following description 
5 taken in conjunction with the accompanying drawings, in 
which like reference characters designate the same or similar 
parts throughout the figures thereof. 
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BRIEF DESCRIPTION OF THE DRAWING 

The accompanying drawings, which are incorporated in 
and constitute a part of the specification, illustrate embodi- 
ments of the invention and, together with the descriptions, 
serve to explain the principle of the invention. 

FIG. 1 is a block circuit structural diagram showing an 
embodiment of the present invention; 

FIG. 2 is an explanatory view showing an aperture mask; 

FIG. 3 is an explanatory view showing a fundus image on 
which a synthesizing process has been performed; 

FIGS. 4A, 4B, and 4C are explanatory views showing 
different kinds of aperture masks; 

FIG. 5 is a flow chart showing a low pass filtering process; 



FIG. 



Therefore, aperture mask images corresponding to plural 
sizes are stored in the aperture mask input unit 4. 

Even in the case where the same image pickup unit 
(fundus camera unit) is used, an image size of a fundus 
; image can be changed when it is outputted. In this case, 
because the aspect ratio of the fundus image is identical, the 
type of aperture mask is selected according to the image size 
of the fundus image. Therefore, even in the case where the 
fundus image is enlarged or reduced, a size of the aperture 
3 mask can be adjusted to the image size of the fundus image. 
The aperture mask input unit 4 may be constructed such that 
aperture mask images are prepared in advance according to 
the image pickup unit to be used, and an aperture mask 

= _ image is selected based on an image size of an inputted 

6 is a flow chart showing an apertuiTtaw^g 15 ^us image. Alternatively, the aperture mask input unit 4 



filtering process; 

FIG. 7 is an explanatory \ 
synthesizing process; 

FIG. 8 is an explanatory 
Art; and 

FIGS. 9A and 9B are enlarged views showing step por- 
tions in Related Background Art. 



showing an aperture mask 
v for Related Background 



may be constructed such that a ratio between the image size 
of the fundus image and a size of a fundus portion thereof 
and a position of the fundus portion are set as numeral value 
information, and an aperture mask image is automatically 
) generated based on the image size of the inputted fundus 



FIG. 5 is a flow chart in the case where a low pass filtering 
process is performed on the aperture mask. First, in Step SI, 
aperture mask data is inputted to the image processing 
25 apparatus 3. Then, in Step S2, the aperture mask data is 
developed to the image memories 5 and 6. Subsequently, in 
The present invention will be described in detail with Step S3 ' the . low P assfi ! terin g P rocess is performed o: 
reference to an embodiment shown in FIGS. 1 to 7. 



aperture mask data and then the aperture mask data is stored 
cr „ i • ui i • ■ , - , in the storage device 7. Even in the case where plural kinds 

FIG. 1 ts a block 30 of apertureLsks are used, the same process performed 

■c the aperture mask data. 
In the case where the process is performed in advance, 



fundus image processing apparatus according to an embodi- 
ment of the present invention. A fundus camera unit 1 is 

from the fundus onto an image pickup device. The fundus , 
camera unit 1 is a unit which includes an optical system, a 
mechanism, and an electrical unit, which are known, and 
takes an image of the fundus of a person to be examined to 
generate fundus image data. An output of the fundus ci 



is possible to 



the image size of an inputted fundus image 
s 35 perform the process speedily. 

FIG. 6 is a flow chart showing an aperture mask process. 
First, in Step Sll, the fundus image data taken by the fundus 
camera unit 1 is inputted. Then, in Step S12, header infor- 
mation of the inputted fundus image data is analyzed t< 



nput interface 2 that inputs the fundus image data. An Mo ^ t ■ c . C1 - , . . 6 , , " 



an input interface 2 that inputs the fundus image data, 
aperture mask input unit 4 that inputs an aperture mask 
image is connected with the image processing-apparatus 3. 

An output of the image processing apparatus 3 is con- 
nected with a first image memory 5, a second image memory 45 
6, a storage device 7, and a display memory 8. An output of 
the display memory 8 is connected with a display device 9. 

FIG. 2 is an explanatory view showing the aperture mask 
image included in the aperture mask input unit 4. In FIG. 2, 
a region C is a region for masking the fundus image data and 50 
a region D is a region for outputting the fundus image data 
without masking it. 

FIG. 3 shows a fundus image synthesized with the aper- 
ture mask. In FIG. 3, a mask area E indicates a masked 
image portion, a fundus image region F indicates a fundus 55 
image which is not masked, and a boundary region G 
indicates a boundary portion between the aperture mask and 
the fundus image. 

FIGS. 4A to 4C are explanatory views showing aperture 
masks, in which a fundus image region H having a diameter 60 
of d is an area in which an image is picked up by the fundus 
image unit 1. As shown in FIGS. 4A to 4C, a size of a mask 
area I around the fundus image region H is changed accord- 
ing to an image pickup plane. In other words, with respect 
to an aspect ratio of the taken fundus image, there are, for 65 
example, three types as shown in FIGS. 4A to 4C, so that an 
aperture mask image corresponding to each type is required. 



Next, in Step S13, an aperture mask is selected based on the 
obtained image size of the fundus image. In Step S14, the 
aperture mask selected in Step S13 is inputted as aperture 
mask data. 

Subsequently, in Step S15, the image size of the fundus 
image is compared with the image size of the aperture mask 
image. When the image size of the fundus image is equal to 
or larger than the image size of the aperture mask image, the 
process goes to Step S16. On the other hand, when the image 
size of the fundus image is smaller than the image size of the 
aperture mask image, the process goes to Step S17. 

In Step S16, the image size of the aperture mask image is 
adjusted to the image size of the fundus image, and then the 
fundus image data and the aperture mask data are developed 
in raster format to the first image memory 5 and the second 
image memory 6, respectively. The fundus image data is 
converted into a 24-bit color (24 bits are allocated for a 
pixel.) and divided into respective colors of R, G, and B for 
development. In addition, the aperture mask data is devel- 
oped using an 8-bit (8 bits are allocated for a pixel.) gray 
scale in raster format according to a gradation of the fundus 
image data. In Step S17, the image size of the fundus image 
is adjusted to the image size of the aperture mask, and then 
the same process is performed for raster development. 

Subsequently, in Step S18, a coefficient for the low pass 
filtering process is determined according to the image size of 
the fundus image. In the case where the image size of the 
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fundus image is large, the degree of the low pass filtering or When the fundus image data on which synthesizing 

the repetition number of filtering process is increased. process has been performed is stored in the storage device 7, 

Therefore, a slope of the boundary region between the the aperture mask image may be binary data or the 8-bit data 

aperture mask and the fundus image can be made gentle. as indicated by the line LI in FIG. 7. 

However, in the case where the image size is small, the 5 According to the above-mentioned expression, after the 

development of the slope is alleviated, thereby reducing the completion of the low pass filtering process, the black data 

number of blurred fundus image. (=0) is outputted in the region in which the data of the line 

In Step S19, the low pass filtering process is performed on L2 is 0. The fundus image data is outputted as it is in the 

the aperture mask data. When the low pass filtering process region in which the data of the line L2 is 255. The fundus 

is performed on the aperture mask data, even in the case io image data whose intensity is reduced is outputted with 

where any of aperture masks as shown in FIGS. 4A to 4C is reducing the value of the line L2. In the case where such 

used, an effect caused by the low pass filtering process process is performed, the steps in the boundary region 

appears along a boundary line between the fundus image between the aperture mask and the fundus image are unno- 

region H having the diameter of d and the mask area I. ticeable, thereby obtaining a uniform image with a small 

Therefore, the boundary line becomes a blur state. 15 visible noise. Therefore, the fundus image data in which the 

In Step S20, the degree of clearness of corresponding steps in the boundary region between the aperture mask and 

fundus image data is calculated based on each pixel value of ^ "s image are unnouceable can be produced. In 

the aperture mask data on which the low pass filtering particular, in the case where diagnosis is performed using a 

process has been performed and the calculation result is monitor or a pnnted 0Ut P ut ' as compared with a conven- 

outputted to the second image memory 6. After the process 20 tional ima S e . the ? eps are unnoticeable and a visible noise 

is performed for all pixels of the fundus image, the fundus « sma11 ; ^ & fatl £ ue of * e " ewer can ^ * A ff «? d 

area in the fundus image is moved to predetermined coor- diagnosing operation can be efficiency performed. In the 

dinates in Step S21. This is because the masked black region case where the produced image is compressed again for 

is used as a region for displaying or printing image taking * ora S e or transmission to another location, an unnecessary 

information and patient information. Note that, if it is 25 harmomc component in the image can be removed, so that 

unnecessary to move the fundus area, this processing step f compression size can be reduced, a compression time can 

can be skipped. In Step S22, the final image data is outputted be shortened, and storage efficiency and communication 

to the storage device 7 and the display memory 8 and then efficiency can be improved. . . 

a series of processes are completed. The above-mentioned processing is performed on each of 

_ . . , . e 30 the RGB images but the following may be alternately 

FIG. 7 is an explanatory view showing a process for ^ ^ RQB ^ * y ^ 

synthesizing the aperture mask data with the fundus image * above-mentioned processing is performed on 

data. „ FIG. 7 an X-coordinate indicates a pixel coordinate ^ ^ . J and ^ J Ytjy ^ - s 

on a line of a horizontal portion J which is the boundary ^ RGB data. 

between the fundus image and the aperture mask as shown , ,, u tu f, a „™„ „„;, 1 i„ „„h 

■ ^ t j j- • \, j- K ■ j- . . . , 35 In the case where the fundus camera unit 1 is specified and 

■n FIG 2. In addition, a Y-coordinate indicates each pixel ^ ^ ^ mask 

\ ffT t ^ ?\ u t T Ee t IT,' election), Step S14, and Ste| S17 shown in FIG. 6 can be 

synthesized data are overlapped with each other to obtain a ^ ^ aperture ^ may fe reduced fa ^ 

grap ' . according to the size of an inputted fundus image. In the case 

In FIG. 7, a line LI indicates aperture mask data on which 4Q whcre ^ size of the image h larger &m a certain 

the low pass filtering process is not performed. As shown by ^ [he 1qw ffltering process ^ S[ep sl8 can be flxed 

the line LI, data is 0 in the region C indicated by an oblique In the case whefc the aperture mask image processed in 

line in FIG. 2 and changed from the left in the right direction, advance as sho wn in nG . 5 is used , a processing speed can 

and a value of that data becomes 255 at the boundary portion fee i mproveQ 

between the aperture mask data and the fundus image data 45 An 0 p hthalmologic irnage process j ng apparatus that pro- 

on the honzontal portion J. duces a synthesized image with less sense of discomfort in 

A line L2 indicates aperture mask data on which the low synthesizing processing for synthesizing the fundus image 

pass filtering process has been performed and is a gentle w j tn tne aperture mask image as described above can be 

curve joining data of 0 to data of 255. This image data has provided. 

a gray scale. Therefore, the Made data gradually becomes a 50 It j s needless to say that the object of the present invention 

gray and further gradually becomes white. j s accomplished by providing to a system or an apparatus a 

A line L3 indicates an example of G-color data of RGB storage medium in which a program code of software which 

colors of the fundus image data corresponding to the region realizes the functions of an apparatus or a system according 

D shown in FIG. 2. The intensity gradually increases from to the embodiment is stored, and causing a computer (CPU, 

the left to the right direction. The calculation using the data 55 MPU, or the like) of the apparatus or the system to read out 

of the line L2 and the data of the line L3 is performed by the the program code stored on the storage medium and execute 

following expression to obtain an output image. This process the program code. 

(calculation) is performed on each of the RGB color data. in this case, the program code itself read out from the 

storage medium realizes the function of the embodiment, 

Outpot daphne 13 data).(lme 12 data + l)/256 ^ ^ ^ ^ me( j ium Qn wMch the program code is 

A line L4 indicates pixel data of a fundus image on which stored and the program code constitute the present inven- 

synthesizing process has been performed. An interval K tion. 

indicates a width of a slope portion of the aperture mask on A ROM, a floppy (registered trademark) disk, a hard disk, 

which the low pass filtering process has been performed. In an optical disk, a magneto-optical disk, a CD-ROM, a 

the case where the coefficient for the low pass filtering 65 CD-R, a magnetic tape, a nonvolatile memory card, or the 

process or the number of processes is increased, the width of like can be used as the storage medium for supplying the 

the slope portion extends. program code. 
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Further, it is needless to say that the scope of the present 
invention includes not only the case where the function of 
the embodiment is implemented by executing a program 
code read out by a computer but also the function of the 
embodiment is accomplished by causing an OS or the like 5 
which operates on the computer to perform a part or all of 
the actual operations based on instructions of the program 
code. 

Further, it is needless to say that the scope of the present 
invention includes the case where the function of the to 
embodiment is accomplished by writing the program code 
read out from the storage medium into a memory which is 
provided on a functional expansion board inserted into a 
computer or in a functional expansion unit connected to the 
computer and then causing a CPU or the like provided in the 15 
functional expansion board or the functional expansion unit 
to perform a part or all of the actual operations based on 
instructions of the program code. 

In the case where the present invention is applied to such 
a program or a recording medium in which the program is 20 
stored, the program is composed of, for example, program 
codes corresponding to the flow chart shown in FIG. 6 as 
described above. 

What is claimed is: 

1. An ophthalmologic image processing apparatus that 25 
masks a fundus image using an aperture mask image, 
comprising: 

input means for inputting the fundus image; 

image generation means for generating an aperture mask 
image in accordance with information of the fundus 30 
image or inputting the aperture mask image; 

image adjustment means for adjusting a value of the 
fundus image, wherein the image adjustment means 
comprises a smoothing means for performing a low 
pass filtering process on the aperture mask image, and 35 
the image adjustment means adjusts the value of the 
fundus image in accordance with a pixel value of the 
aperture mask image on which the pass filtering process 
is performed; and 

synthesizing means for synthesizing the fundus image 40 
whose value is adjusted with the aperture mask image, 

wherein the image adjustment means adjusts the value of 
the fundus image based on coordinates in a boundary 
between a mask area of the aperture mask image and an 
area of the fundus image. 45 

2. An apparatus according to claim 1, wherein the image 
adjustment means reduces a pixel value from the boundary 
between the mask area of the aperture mask image and the 
region of the fundus image to an outside of the mask area 
and increases the pixel value from the boundary to the inside 50 
of the mask area. 
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3. An apparatus according to claim 1, wherein the image 
adjustment means adjusts the value of the fundus image by 
multiplying the fundus image by a coefficient proportional to 
the pixel value of the aperture mask image on which the pass 
filtering process is performed. 

4. An apparatus according to claim 1, wherein the image 
generation means comprises comparison means for compar- 
ing a size of the fundus image with a size of the aperture 
mask image, and 

the image generation means adjusts the size of the aper- 
ture mask image in accordance with a comparison 
result of the comparison means. 

5. An apparatus according to claim 1, wherein the image 
generation means comprises selection means for selecting 
one of the aperture mask images in accordance with a size 
of the fundus image. 

6. An apparatus according to claim 1, wherein a number 
of bits of a gray scale of the aperture mask image is different 
from a number of bits of one pixel for the fundus image. 

7. An apparatus according to claim 1, wherein the smooth- 
ing means adjusts a degree of the low pass filtering process 
in accordance with a size of the fundus image when the low 
pass filtering process is performed. 

8. An apparatus according to claim 1, wherein the image 
adjustment means comprises moving means for moving a 
fundus area in the fundus image whose value is adjusted to 
predetermined coordinates on the fundus image. 

9. An ophthalmologic image processing method that 
masks a fundus image using an aperture mask image, 
comprising: 

an inputting step of inputting the fundus image; 

an image generating step of generating an aperture mask 
image in accordance with information of the fundus 
image or inputting the aperture mask image; 

an image adjusting step of adjusting a value of the fundus 
image, wherein the image adjusting step comprises 
performing a low pass filtering process on the aperture 
mask image; and adjusting the value of the fundus 
image in accordance with a pixel value of the aperture 
mask image on which the pass filtering process is 
performed; and 

a synthesizing step of synthesizing the fundus image 
whose value is adjusted with the aperture mask image, 

wherein in the image adjusting step, the value of the 
fundus image is adjusted based on coordinates in a 
boundary between a mask area of the aperture mask 
image and an area of the fundus image. 
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